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of a typical use of an oil refinery model based on mathematical programming. The 
environment of the real world contains many intangibles that are not accounted 
for in the model. The use of subjective probability in decision-tree analysis allows 
the decision-maker to include his feelings about these intangibles in a quantitative 
5 way and enables him to consider many more intangibles than he does when he has- 5 

ed his decision on the combination of judgemental factors and the results of the 
deterministic model. . , , . « • 

Sensitiviiy analysis may be used to show the decision-maker those subjective 
probabilities ifi his situation which are most significant in yielding the results in- 
10 dicated. He can then profitably spend more time considering the probability of the 10 

more important events. Sensitivity analysis can also be used to show the decision- 
maker what would happen if his worst fears regarding a chance event should 
become a reality. - ■ 

With the theory developed to this point and a large number of people trained 
15 in these concepts, one would expect to find a substantial amount of literature 15 

describing their application to many problems. Very little application literature ex- 
ists. Brown (1 ) has conducted a survey of the use of decision theory analysis. Raiff a 
(10) has applied all the concepts except sensitivity analysis to the decisions which 
occur in prospecting for oil. Schlaifer (12) mentions several business situations. 
20 Hespos and Strassman (4) discuss the application of probability distributions to 20 

decision trees for investment decision-making in such business fields as new 
product introduction. Fulton (2) mentions the use of decision trees in new plant 

location. , . . r 

There may be reasons why more authors have not written about the use ol 
25 these concepts. Lack of use is probably the principal reason. Brown (1) supports 25 

this conclusion. 

Many decision-makers, when faced with a non-programmed decision, are in- 
tuitive. They assembled the facts related to the problem and then wait until a 
bright idea occurs to them. They evaluate this idea and use it if it offers a 

30 reasonable solution. Here, "reasonable" means the solution does not contain ob- 30 

vious defects, it satisfies some of their objectives and it contains sufficient novelty 
to appeal to those most concerned with his solution. The solution is also quite like- 
ly to be similar to the decision-maker's previous decisions and to lead to situations 
which he can control. He is willing to sacrifice return to meet these criteria. An in- 

35 tuitive problem-solver is not likely to use the concepts being discussed. 35 

. Others follow more elaborate steps similar to those described by Simon (14) 

consisting of: . 

1. Finding, inventing, developing and analyzing alternate courses of action. 

2. Selecting the particular course of action from those available in a consistent 

40 manner to maximize their return. 40 

Many decision-makers fall into this category, yet apparently the concepts un- 
der discussion are not widely used. Little (6) probably has the answer. He says 
"The big problem with management science models is that managers practically 
never use them". He goes on to say that much of the problem lies "in the meeting 

45 between the manager and the model". Brown (1) discusses the need for a better 45 

"package*' so that an executive can contribute information and receive con- 
.. elusions "in a more effective, appealing manner". Sutherland (15), among others, 
has also discussed this problem. This interface is a substantial barrier for the con- 
cepts discussed. , 

50 The use of computers having graphic interactive display facilities can reduce 50 

this barrier and make the use of decision trees a practical everyday tool for those 
who have been taught the concepts. Some work has already been done to reduce 
this barrier. Schlaifer (13) of the Harvard Business School, has written a series of 
computer programs for the assessment of subjective probability distributions and 

55 preference functions. These programs are written in FORTRAN IV and are 55 

available from the Business School. Computer programs have also been written to 
solve decision trees using means probabilities and folding back from the terminal 
values. 

Irwin Miller (8) has described the use of a graphic display for decision making. 
60 His work is directed to the solution of marketing and production problems using 60 

mathematical equations which describe the relationship between the variables. 

According to the invention, there is provided a data processing system in- 
cluding a central processor, a graphic display unit, and programming means which 
cause the system to generate and display a decision tree, to assign probabilities and 
65 expected values to selected branches of the tree in respbnse to input data, to 65 
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FIG. 18 shows a display showing results of automated sensitivity analysis on 
the expected values; 

FlG. 19 shows the results of a sensitivity analysis on the first three branches; 
FIG. 20 shows the results of a preference analysis using the preference curve 
5 of FIG. 16; and 5 

FIG. 21 is a block diagram showing a computer system in accordance with the 
present invention. 

Description of the Preferred Embodiment 

1. Concepts 

10 This portion of the specification discusses the concepts of utility theory, sub- 10 

jective probability, decision tree analysis, sensitivity analysis and those related to 
the computer such as interactive mode and problem-oriented languages. These . 
concepts have been used in developing the decision maker's tool under discussion. 
The alternative concept of Monto Carlo simulation which has been used previous- 

15 ly in decision analysis is discussed. A comparison from the point of view of the 15 

decision maker is made between the chosen concepts and the alternative. 

2. Utility Theory 

Most people including decision makers in companies have a non-linear 
preference for acquiring new assets which depends on the value of the asset and 

20 the risk involved in acquiring it. For instance, if offered a choice between a certain 20 

$500,000 and a 50 — 50 gamble of winning $1,000,000 or losing $100,000, most peo- 
ple of average means would choose the certain S500,000. They could deposit this 
money in a savings bank or invest it in bonds and receive a comfortable income for 
life. The prospects of receiving $1 ,000,000 would not be a great deal more attrac- 

25 tive. In fact, tor most individuals, an opportunity to receive $1,000,000 in a lump 25 

sum is not worth twice as much as an equal opportunity fo receive $500,000. 
However, the possibility of losing $100,000 which would mean bankruptcy, would 
be the main factor causing them to choose the certain $500,000, even though the* 
expected value of the gamble is $500,000. But a person who has ample resources to 

30 withstand the loss and who likes to gamble might prefer the gamble. 30 

This discussion shows that the desirability or preference for money is not a 
linear function of the amount of money involved. If one plots preference as a func- 
tion of amount of dollars, the curve will become concave either upwards or 
downwards when considering gains, depending on whether the decision maker is a 

35 gambler or prefers to avoid risk. 35 

Swalm (16) has shown that combinations of the two shapes also occur fre- 
quently. When considering both gains and losses, a conservative decision maker 
may have a curve that is concave upwards for losses and concave downwards for 
gains. 

40 The spread of possible returns is one method to account for a decision 40 

maker's preference for the certain $500,000 over the gamble illustrated above. A 
frequently-used measure of spread is the variance. But this technique fails in the 
case of choosing between the two lotteries shown in FIG. 1 . Both lotteries have the 
same expected value and variance. Many people would prefer the second lottery 

45 where they cannot lose any money but would have a probability of 0.1 of winning 45 

the terminal value of $10,000. 

Utility theory has been developed to account for people's preferences when 
they wish to be consistent in their choices. A reference lottery is considered where 
the terminal values are the maximum and minimum amounts to be considered. 

50 Preference values are established for assumed amounts between the terminal 50 

values by assigning probabilities (P, 1 — P) that make the reference lottery 
equivalent in the decision maker's mind to the assumed amount. The assigned 
probability, P, then becomes the preference value or "utile" for the assumed 
amount. 

55 A decision maker may find it easier to determine his preference using 50 — 50 55 

lotteries. The first lottery is one of a .5 probability of obtaining the maximum 
amount and a .5 probability of obtaining the minimum amount. The decision 
maker is asked to express his value of this lottery in dollars. The value is called the 
certainty monetary equivalent (CME) of the lottery. The preference measurement 

60 for the CME is 1/2, since a preference of 1 utile has been assigned to the largest 60 

amount and 0 utile to the smallest. The next lottery is a 50 — 50 gamble on the 
minimum amount and the CME of the previous lottery. It has a preference of 1/4 
utile. The process is continued to obtain additional points on the curve. 

A preference curve of utiles vs. dollars as determined by one of the 
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Hespos and Strassman (4) do mention the possibility of allowing the computer 
to eliminate some decision paths based on their definition of dominance. "For ex- 
ample, a branch could be eliminated if it had both a lower expected return and a 
higher variance than an alternative branch". This can be dangerous, as will be 
5 shown. „ 5 

Consider the conservative decision maker discussed previously. Change the 
second lottery so that he now has a choice between the two lotteries shown in FIG. 
4. 

If he had only a few thousand dollars in the bank, he would prefer the second 
10 lottery, which has a smaller expected value and a larger variance, in order to avoid 10 

the possibility of going into debt. 

In order to determine the utiles, a new preference curve must be ascertained, 
since the new lottery is for a larger sum than considered previously. Suppose the 
new curve turns out to be as shown in FIG. 5, where both preference curves have 
15 been drawn to illustrate their similarity. 15 

The new preference curve yields a utility of .63 for the first lottery and .66 for 
the second. This discussion shows there is danger in using this type of dominance 
as a basis for automating decisions and that utility theory offers an advantage. 
True dominance, where there is no overlapping of the probability density 
20 functions, is a perfectly acceptable method to be used in computer decisions. 20 

However, the number of instances where true dominance occurs in business 
decisions under uncertainty will not be sufficient to make it worthwhile. 

A change in the type of venture must also be recognized. A decision maker 
might have entirely different preference curves for a venture into the stock market 
25 and one into a horse race. . ' . 25 

The use of utility theory enforces consistency into decision making. For in- 
stance, it prevents a decision maker from changing his opinion about a version to a 
specific loss as the amount of money to be gained increases. Consider as an exam- 
ple our decision maker who has the preference curve in FIG. 2. He would be in- 
30 different to the two lotteries shown in FIG. 6, in spite of the fact that the maximum 30 

amount of money to be gained in the second case is larger. The probability of the 
increased gain is less so that the expected utility of both lotteries is the same. 

Note that the conservatism of the decision maker, as expressed by his 
preference curve, has caused him to attach no increased value to a lottery having 
35 an expected value which is larger by a factor of more than three. If the decision 35 

maker does not feel he would actually consider the two lotteries to be equal, then 
he is either being inconsistent or his preference curve should be revised. A 
preference curve should be tested after the original assessment by situations such 
as these to insure validity. 
40 3. Subjective Probability . . 40 

Subjective probability may be defined as a measuie of the decision makers 
degree of belief of the occurrence of an event as evidenced by his action pattern. 

Many decision makers who have not been trained in subjective probability 
assessment techniques do not believe in using probability to make decisions. One 
45 of their main arguments is that they cannot assign a number to a chance event 45 

about which they know very little. 

One of the premises of the present approach is that a decision maker, when 
making decisions under conditions of uncertainty, should use all the significant in- 
formation available to him. For instance, he should not neglect to assign a 
50 probability to an event which he believes will produce an appreciable effect on the 50 

outcome of his project just because he finds it difficult. In the process of using the 
decision tool disclosed herein, he will find out those probabilities which can affect 
the decisions or values materially and those which need not be considered further. 
The decision maker may then reassure himself by searching for more information 
55 about the significant probabilities with some assurance that he is not wasting his 55 

time. . , , 

If the decision maker is not willing to use all the information he has, i.e., assess 
probabilities of uncertain events, and if this information is significant, he probably 
will make the wrong decision. In effect, he has assumed that the event will not oc- 

60 cur. Yet he knows that there is a possibility that it will. Hence, he is being inconsis- 60 

tent in his decision-making and should assign a probability to the event. 

The decision maker must exercise caution in distinguishing between the value 
of an event and the probability of that event. He must not account for uncertainties 
in both items. For instance, if he assigns what he believes to be a large value to an 

,65 event he should reflect this doubt in the probability of that value and not account 65 
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for his uncertainties twice by reducing both.the value and the probability in an un- 
related manner/ * ■ * 

4. Decision Tree Analysis. ^ - , . , -.: - . 

A decision tree is made up of alternating decision and event nodes inter- 
S connected by the branches. Each- node has only one branch on the left side but 5 

many have any number of the right. The probability of an event is noted by assign- 
ing a probability to tKat branch. The sum of the probabilities for all the branches, 
leading from a chance node must be one. The number of stages in a tree is the * 
number of nodes found along the path composed of branches which has the m ax- 
to imqm number of nodes., ^ - - >* v ; . ' . .. 10 
The last stage in the tree is composed of event nodes and the branches leading 
from these nodes end in terminal values. These terminal values are the payoffs for 
the branch associated with that event. A simple decision tree taken from Hespos 
and Strassman (4) is shown in FIG. T. ; . • 
15 The optimal sequence of decisions in a tree is found by a technique called 15 
"averaging out and folding back". Starting with the terminal values associated 
with a node, the expected value for that node is determined by talcing the sum of 
the products of the terminal values and their associated probabilities. The max- 
imum expected value is chosen for each decision node and the process repeated 
20 until an expected value is obtained for the first decision node. This is then called 20 
the value of the proposition and the chosen decision branches represent the op- 
timum, decision. , « 

The concept of decision tree analysis provides a systematic approach to many 
management problems. The format enables a decision maker to break down a 
25 complex problem into a number of simpler ones. According to the thoughts of 25 
Miller (7) this should enable a decision maker to consider more possibilities. In ad- 
dition, following the decision tree format may suggest additional possibilities that 
should be considered. The problem of handling too many alternatives will be dis- 
cussed in the next section. \ 
30 5. Sensitivity Analysis, "* % - ■ 3P 

Sensitivity analysis is commonly used in operations research to determine the 
effect changes in input parameters have on the proposed solution; In the present 
case, the decision maker is understandably concerned regarding the accuracy of 
the probabilities he is using in his decision tree analysis. __ 
35 Two types of sensitivity analysis have been implemented in the work under 35 

discussion. An automated sensitivity analysis determines which probability along 
the preferred decision path is most sensitive in changing the path and which is 
most sensitive in changing expectation. This type of sensitivity analysis is limited to 
determining the effects of changes in probability close to the value the decision 
40 maker has specified. 40 

If the decision maker suspects that he may have made larger errors in assign- 
ing some probabilities, especially those not on the decision path, he will want to 
determine the effects of changes in those probabilities. He may select any 
probability on the tree, change it and the computer will determine the new expec- 
45 tation and decision path. A decision maker would also use this type of sensitivity 45 
analysis to determine if he should reject an undertaking because of difficulties in 
assessing one or more probabilities. Sensitivity analysis can tell the decision maker 
which of these probabilities: 

1. Is most critical in obtaining the previously computed expectation of the 

50 proposition. . - . - 50 

2. Is most critical in changing the decisions required to obtain an optimum ex- 
pectation. ... . . A . — . 

3. Is not significant in determing either expectation or decision path. The 
decision maker can prune branches containing such probabilities and, if he wishes, 

55 add additional alternatives. . . 55 

Once the decision maker knows what probabilities are most critical, he can 
then concentrate his efforts on revising them without feeling he may be wasting his 
time on inconsequential factors. Or, he may choose a set of decisions which, while 
less optimum, have a smaller probability of producing a loss. 

60 In effect, sensitivity analysis, when combined with decision tree analysis based 60 

on using utiles instead of dollar value, provides the decision maker with results 
which are similar to the stochastic decision tree analysis of Hespos and Strassman 
(4). Since only a few changes in probability need be made instead of generating 
changes at random, results can be obtained in a much shorter time than with 

65 simulation. Substantial savings in the decision maker's time are possible. The 65 
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7. Implementation 

The purpose of this invention is to provide a decision maker who has had pre- 
vious training in the use of decision tree analysis, subjective probability and utility 
theory with a tool to use in making decisions using decision tree analysis. The tool 
5 is designed to reduce some of the man-machine interface problems which occur 5 

when a computer is used to perform decision tree analysis. The preferred approach 
is to combine a small computer having graphic display and light pen selection 
capabilities, with a problem-oriented language and a flexible program, in a manner 
to facilitate operating in an interactive mode. 
10 Such operation is fostered by display of the interrelationships of the supplied 10 

data,, selection of program alternates by light pen and rapid computer response. 
Error detection is provided to simplify the process of supplying data. Both an auto- 
mated and a selected sensitivity analysis are provided to enable the decision maker 
to answer "what if'^questions regarding the effects of changes in probability on 
15 expectation and decision path. Choices at the decision nodes are selected by the }5 

computer. The selection is based on maximizing expected value or expected utility. 
In the latter case a preference function supplied by the decision maker is used. 
Guides are provided for the decision maker to use in assessing his preference 
function, and the effects of changing the function may be determined. Sufficient 
flexibility is provided to allow the decision maker to structure and solve his problem 
using a trial-and-error technique. No previous experience with programming is 
required. * 

This chapter discusses those aspects which are believed to be most significant 
in achieving the objective. The hardware is discussed first, followed by a section 
25 describing the program functions. Sections on the input procedure and sensitivity 25 
analysis follow. The final section discusses the solution of a hypothetical decision 
problem involving the drilling of an oil well. At the end of the specification, there 
are a list of subroutine functions and a list of the complete program with 
explanatory comments. 

30 8. Hardware 30 
Referring to FIG. 21, there is disclosed an IBM (R.T.M.) 1130 Model 3D 
computer having a central processing unit 1. A 2250 Model 4 graphic display 2 was 
chosen for implementation. The computer has 32,768 sixteen-bit words of core 
storage in memory 5 and operates with a storage cycle time of 2.2 microseconds. 

35 Both the storage capacity and cycle time are quite adequate. A total of 25,000 35 
words of core are used. A computer having a smaller direct access memory (16,000 
words, for example) could be used at the expense of waiting several seconds at 
some point in the program execution for the memory to be erased and reloaded. 
Previous experience with an 1130 computer having only 8,192 words of core 

40 memory indicated that this size memory was inadequate. The initial input and 40 
graphic subroutines require more than 9,000 words. Disk Storage 6 is used for the 
mainline program, the subroutines, the data for 16 problems and the FORTRAN 
compiler. 

The CRT graphic display 2 has a usable area of 12 inches by 12 inches, 

45 although this is considered by the experimental graphic subroutine package to be a 45 
10-inch square. The smallest single step is 0.01 inch giving a roster of 1 ,000 by 1 ,000 
available elements. The smallest character which can be displayed using the sub- 
routine package is 0.14 inch by 0.14 inch. Allowing a minimum spacing between 
characters* only 66 branches of a decision tree can be labeled. Consequently, the 

50 tree has been split into four vertical sections during the input phase, as will be dis- 50 

cussed in the section on input procedure. The 2250 display unit 2 can generate a 
complete display in a few seconds. Regeneration of the display is automatic. 

A fibre-optic light pen is provided with the graphic display 2. This allows the 
user to select previously-designated alternates in the program. The input section 

55 describes the use of the light pen. 55 

A group of pushbuttons called function-keys is also available on the function 
keyboard 10 for making predetermined modification to the program. Lights 
associated with each function-key indicate whether the key is on or off. Two of the 
keys are used, one to advance the program to the next step and the other to enter 

60 zeros for all the terminal branches of the tree associated with a node. 60 

Three methods are available fdr supplying hard copy output of the display. 
The IBM (R.T.M.) Model 2285 display copier 8 may be used to provide 84 by 11 
inch paper copy of the associated 2250 display 2. The experimental graphic sub- 
routines which are used make use of a copying feature to duplicate the display on 

65 the Model 1627 plotter 4. The plotter 4 has X and Y increment speeds of 18,000 65 
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!S££tSS P mlutS U £e a ?e d aui?ed XT ^ °f 600 operations P e7 " 

favored by the aS? h? to^hotograoh Sie d£„l™T P,ete d «P»*y- The method 
ground glass back for focusing and MimiH ^?! I scre f n - " s ' n 8 a camera with a 
5 52 Lan<f fil m . Exposures of 3S U25 «S„J SfJ ment whl< * 11568 4 x 5 inch type 

satisfactory results with the dtariav h2m w a ,ens °P enin 8 of « have given c 
exposure should no Tbe Tused SwmK^ * a r mode / at « ,evel " A ^te? 5 
1/30 second. complete regeneration of the display may require 

10 branched 'IS^JS^S^ ^^V"^ & "* ° f the decision 

gram. The mainprogran* aud s2iS^^'5SLfS d » required V° start the P r °- 

Thefcfo C nf a n re^ 

description of the operating oroSfK "Zff 8 8 and 9 - A more detailed 20 

The first display consiste of a 1M nfrtL be found in the next section, 
stored problems aVthe wol5 "new" The deck iS ff ^ aS - L 6 P re viously- 
stored problems or "new" If he select, ion* 3? 522 *£ r SeIe ? tS e,ther one of ^ 
with the previously stored datJ pSSed I on ^JSS^SiS^u^^ 1 ^^ 
proceed to revise his values or add more H«t. f ? ran 4 ches - He may then 25 
instead pass on throueh "caLuI fl t£? Mn?i by sel . ec V n 8 correct". He may 
preference curve 6 c ^ulate to perform a sensitivity analysis or assess his 

30 tUm^^^S£^tiSSS^Si& iS ? kh a series °f ^rue- 

supplying data L oSSSd S Se1^ S s tcUon SeCt, ° n ° f thC *" S ° he may start 30 

and its associated PtobaMitv for^JK tSS P?*?? 8 , of each terminal value 
35 for each tlurd-stagen ode is sellttedV^f thf n ° dc - ^ lar & est expected value 

the second stage probaiK averaging process is repeated using 35 

the expected value of the 1^^^^n of ^^"^ «^y iel * 
values, are displayed on tKeiS'sSn £ HG To The corr^o^ 
are broadened for easier identification corresponding branches 

the Janc^Th^S SSfif-Sf TySS^ 0 ™^ - to 'J/™* 6 ~- «f 
additional alternatives that hTwfahe^ tc fj£j£?$L n . ew . branches representing 

then averages out, folds back S *t?J? . on ^ we en the assessed points. It 
displays thf results as Sfo« Befo^^r£ult^~ °[ the P ro -> ects a °d 

back into quantities having the ^e£™^££* d ^ laved - are converted 
values. At the end of t™ preflrS^ aialKfor ^TrfE* r° r ^ te ^ minal 
section, the decision maker mav select from ant °r 5. ny ° f ** hc f " nct i on s in this 50 
The functions "sensitivitv^ "store" y °U he °P tlons "sted above. W 

the next sections. SensSy an alvsfc is "i 6 ^ 01 .^ d «cribed more fully in 
selected before "preference" h^ Seen ^tt 1 "^ usm 8 expected values it it is 
decision values displaced alwayt have the same nf CXpeCted Utiles ^rward. The 
the terminal values, with thVe^centTon of * ™L d k meMI .° nS u as those su PP"ed for 55 
discussed in the foilowmg section P P ° Mlb,e S ° a,e change to thousands as 55 

10. Input procedure 

probability .re supplid Thc^lindd^riSf.S?. h °f '""Si"? 1 valu « 60 
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SSfiSua^^ " e *"« "** <•» computer. A fo™ con be used to 

10 selection eVror selection. This provision reduces the possibility of a. 

as shoin e i2 C FIG" ?jFj££ of'i^** ?• neW probIem ' the initial ^ee is displayed 10 
describiSA^^ at th * b °«™ of the display 

,5 P°^S^ Way all 

^eTeSl^p^ 15 
arrangement of £ Jchef at ffitoJgZg^Sg^&g*^ * the 

branch^ut^^ 

fSSHe^S 

the user is asked to repeat tffe data Eo7mP«^ thc . r charact er is used, and 

containin g P an P M to remffi^^^^ ^ f «* value 

is «2? JK SSSSSSSStS ft 5£t*5 ft -!"* that this sum 

message is displayed telling the user what the ^.".SS**^ th ". ran 6 e . an error 
the data associated with thf node fn^2ir«f JSSi2L Md ^J^T 8 hlm to re P eat a » 
branches of the tree TWs cheeV?™ w.f^ ? are also erased from the appropriate 
one used for values' checkin 8 f ***™ " «sed for probabilities in place of the 45 

three^vis*^ branches Conse q uent.y, 

ing values for unused brlncheT S toSSSZ^ZS&rST* ? f the USer in ente *- 
end keys on function keyboard 10™ SSS fSra va Sf ^ IHk codin e an d 

and advances the program to the n«rt sten Th? » P robabl . 1, . t y for a branch 50 
function key to enter zlrorfnr all «ftk- L P u The - secon d provision s to use a 
marker is dfs P ?ayed " ode * «>e time. A 

may 'select fhTvalue""^ he , has 6ntered 

the data associated SffSam^S^^ur 1 the P ro f ram w »> delete all 

o'^oehtYd^ f ™ ' 'mitod portion 

™d= to di s p,a y the e P o4lete ^SSSSSLStSSS ftSJ3.tt 65 
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selects "all sections" with the light pen. The tree is displayed after he has provided 
the next terminal value, which can of course be zero. This provision allows the user 
to see the interrelationships in decision-tree format among all the data he has sup- 
plied and plan for the location of future data. He may then select "correct" to 
5 change previous values or continue on with providing terminal values and their s 

probabilities. 

The decision maker may interrupt his work at any time by selecting "store" 
from the menu with the light pen. He might wish to do this because of the pressing 
demands for his attention elsewhere or because he needs time to think about his 
10 problem and perhaps obtain more data. When he returns to the computer, the tree in 

is displayed, showing the data he had supplied previously, and he can continue 
from the point of interruption. 

The description thus far has covered the handling of values and the probabili- 
ties for the terminal branches. Probabilities for the second stage are handled in a 
15 similar way. 

After all the data are supplied, the complete tree is displayed, as shown in FIG 
15, to show the interrelationships of all the data. Terminal branches (i.e., fourth 
stage) having zero probability are eliminated to reduce confusion and provide more 
space for displaying the terminal data. Third-stage branches are eliminated when 
20 the corresponding second-stage probability is zero. 20 

The elimination of the third and fourth-stage branches also enables the 
decision maker to spot errors in the assignment of data. If a probability has been 
assigned to a second-stage branch but not for any of the corresponding terminal 
branches, all the branches leading from the second stage node are shown, but no 
25 connecting terminal branches appear. Third-stage branches are left hanging in 25 

mid-air when the corresponding second stage branch probability is zero. Errors 
have been introduced in the data of FIG. 15 to show both conditions. These 
features show the decision maker that he has not matched second and third-stage 
branches. 

30 Preference Assessment 30 

The method of assessing the decision maker's preference curve is similar to 
that described by Schlaifer (11, 13). The decision maker is asked first to give his 
certainty monetary equivalent (CME) for a 50—50 lottery involving his maximum 
and minimum values. This establishes the .5 utile value. Two similar 50—50 lotterie 

35 combining either the maximum or minimum terminal value and the previously 35 

assessed CME determine the values corresponding to .25 and .75 utiles. 

A curve is displayed drawn through the three assessed points and the maxi- 
mum and minimum terminal values. Each CME is checked using the same input 
subroutines as was used with the terminal values. Display of the curve gives the 

40 decision maker a further check in avoiding possible errors in providing the data. 4c 

The decision maker is provided with two techniques to assist him in eliminating 
inconsistencies in his preference function. He is asked to compare his curve with 
the straight line representing the preference curve of an individual who is willing to 
accept expected monetary value as a basis for decision-making. If his three assessed 

45 points lie on both sides of the straight line in a random fashion for instance, he may 45 

wish to reassess the function. 

The second technique is to have the decision maker give his CME for two 
additional 50—50 lotteries. The two values for the first lottery are the previously- 
assessed values corresponding to .25 and .75 utile, and for the second lottery the 
.25 value and the maximum value are used. If the utile equivalents for these values 5C 
do not he on or close to his preference and the decision maker believes this repre- 
sents an inconsistency, he can repeat the assessment procedure. A completed pref- 
erence curve with checkpoints is shown in FIG. 16. 

? i " ce the sh ape of the preference curve can affect project expectations sub- 

33 stantially, the decision maker may wish to try several curves. The program allows 

him to repeat the assessment procedure and determine the expectation of his 
project for as many different curves as he wishes. He may wish to try a second 
curve, for instance, when he believes he is being consistent in spite of the fact 
that the points for the two check lotteries do not lie on his preference curve. 
11. Sensitivity Analysis 

Sensitivity analysis is performed after the terminal values have been averaged 
out folded back, the project value computed and the decision path determined on 
the basis of maximum expectations, i.e., either maximum expected value or greatest 
expected utility. 

° 5 The automated sensitivity analysis assumes that the decision maker wants to 65 
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S^E«i e ^^ , S-?h Ci S 0 ™. and ex P e ? tations to small changes in those 
about a l SfuSSL £ • deciS1 °? path -. ft assumes that he is more concerned 
coZn^H oni W ?J?Ct V u UC than V inc rease. Two probability sensitives are 
computed one for decision change and one for expectation change. 
th~ L»t P robabu,t y wh i c .h changes the least in causing a decision path change to 
the next lower expectation is selected for the decision change The previous 
™ m S a,1 ° W l hlS P. robabi,it y c hange to be used in determining the • probaKy 
most sensitive in changing the expectation of the protect. The ratio of chance in 
nl P H C fnr t,0n L°J [ he . c . han gc in probability computed Fori decision change Ts deternT- 
u^t the^nl^H n<?de ' Si r e ex P«?atfon is a linear function of probabUky 
n?nh nh nL P ™ ° f a decis lon ch a n g e , this ratio is independent of the change in 
h P r . obabll,t y Producing the largest ratio is selected as the most 
sensitive in producing an expectation change. 

tinn In l£!^ S assurnptions also provide* criterion for determining the reduc- 
tion in expectation used to measure probability sensitivity. This criterion is the 
minimum expectation change which causes a change in IL decision path If an 
increase in expectation were chosen the criterion would be more arbkary 
h.. • .2 , decislon "ode. provided that the chance node following the branch 
th e Th g a ^ ar ^ eSt ex P£ Cta . tion has two or more branches, those branches fo!ow 
tlie chance node and having the largest and smallest expectation are determined 

Svin^Si °£ thC bl ??? h ha ^ ing ^ lar S est expectation is reduced and thai 
having the smallest expectation is increased.The increase is just sufficient to cause 
a previous branch to have an expectation equal to that of the next mo^vomble 
tlffS S? Chang ^ in P r . ob abihty is called the decision probabU t^eniS 
l he l e "nder considerauon. The process is repeated for the branches followine 
a &i h fo P de i? 1S1 t 0n P.ath. The probability most Sensitive in producing a deSn 
change for the tree is selected as the one with the smallest change aecislon 
i«.h.*Jl 8 U P» dec ™ on }™ e Problems the decision to take no Iction must be 
included as an alternative. The event following such a branch has a probabuitv of 
f s 7a£„ an tT am £ le ' ^predetermined amount of money is invested l^d no act^ 
SSSlS asubsequent decision point, the certain return is a loss of the fixed 
investment. No sensitivity analysis Is performed for branches having a probability 
of one; it is assumed that such an event is a certainty prooability 

shnwn^n C CT? P, i e 7 W TK b t USed u t0 cl ^ y S he disc "ssion. Consider the decision tree 

0.41 x (-10) + 0.35 x 22.9 + 0.24 x 77.5 =» 22.5<«> 

The sum of probabilities at a node must always equal one. Conseouentlv if 
the most sensitive probability is reduced by AP B this reduction i ir^st^added'to 

°^n 0 l the , 0tb > er f ^ rob f, bi,ities - Addin 8 il *«» tn c probability associated Sth the 
^'t v £? ue will produce the minimum increase in expected v!due for the 

node. In this case since the smallest value is negative, adding AP* to the associated 
probabi ity also decreases the expected value The changl in th" ^mos^Sive 
Sr^ babl A ty r 31 wu \ ca «se the expected value of branch A-B? to eqSal tha of 
branch A— B, may be determined from the following equation. 

(.41 + AP D ) x (-10) + 0.35 x 22.9 + (0.24 - AP B ) x 77.5 = 20.™ 
probIbHiS ing (2> fr ° m 0) giVCS a f ° rm Which is inde PC" d cnt of the individual 



so 



- AP B x (-10) + AP„ x 77.5 = 22.5 - 20., 



22.5 - 20 AVALUE 

AP B = = = 

77.5 - (-10) V Mia - V M|B 

In other words, if the probability of branch B 2 -Q drops by 0.028 and the 
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probability of branch B 2 Q increases by the same amount, the expected value of 
branch A — B 2 equals that of branch A — B t . 

There are two decision changes that occur when the terminal stage probabili- 
ties decrease sufficiently. A reduction in probability can cause a shift in third-stage 
5 decisions and in first-stage decisions. The change necessary to cause two third-stage 5 

decision branches to have the same expected value is computed using the above 
formula where now. 

A VALUE = difference between third stage branch values, 
v m« = maximum value associated with the terminal node being considered. 
10 V Mln = minimum value associated with the same node. 10 

The method for computing the change in terminal probability that will cause 
the value of the first stage decision branch having the largest value to be reduced 
to the point where it is equal to the next largest first-stage branch value will now 
be described. Introducing the terminal stage probabilities for node D 3 into (1) 
15 yields: 15 

0.41 x (-10) + 0.35 [0.43 x (-80) + 0.34 (40) + 0.23 x (190)) + 0.24 x 77.5 - 22.5.< 3 > 

Introducing the unknown change in terminal probability AP D gives: 

0.41 x (-10) + 0.35 1(0.43 + AP D ) x (-80) + 0.34 (40) + (0.23 - AP D ) x (190)1 + 0.24 x 
77.5 = 20.< 4) 

20 Subtracting (4) from (3) and rearranging produces: 20 

22.5 - 20 

AP D - = .026 

.35 [190 - (-80)1 

Two probability sensitivities are computed for each terminal node which has 
more than one branch and is in the second section, i.e., connected to node B 2 . The 
minimum probability change is selected from the computed values, including 
25 aP b , and reported to the decision maker on the display. ° ; 

The ratio of 

A PROJECT VALUE 



AP 

is also computed for each change in probability and the maximum ratio is the 
probability most sensitive in changing values. 

30 When the probability most sensitive in changing decision is different from the 

probability most sensitive in changing values, both are given in a message on the 
display. The change in probability and the associated branch numbers are also in- 
cluded. In addition, for easy identification these branches are widened in the com- 
plete tree which is displayed. FIG. 18 shows the results of an automated decision 

35 analysis performed on expected values. 

The sensitivity analysis method just described is limited to determining the 
effects of changes in probability close to the value the decision maker has speci- 
fied. If the decision maker suspects that he may have made larger errors in assign- 
ing some probabilities, especially those not on the decision path, he will want to 

40 determine the effects of changes in these probabilities. He can do this by selecting 

"vary prob" with the light pen. The routines which were previously available for 
correcting during the input phase then allow him to select any probability he 
wishes, using the light pen, and he can change it to any desired value. A checking 
routine insures that he maintains the sum of the probabilities equal to one at the 

45 node where he is making changes. A decision maker would also use this type of 

sensitivity analysis to determine if he should reject an undertaking because a 
probability could not be determined with sufficient accuracy to insure an 
adequate return. 

The essential features of this sensitivity analysis are to tell the decision maker 
50 what his most sensitive probabilities arc, how the value of his project changes if he 

has made an error in their assessment and to give him complete flexibility in de- 
termining the effects of large changes in probability. He can observe the effects of 
changes immediately after making the change, which greatly facilitates his ability 



. . 1.390,397 

ll 0 sim n ple%mWem aniiin8 ° f P robabiIit y has in his decision-making. 

vrfoSf i? r t°w of USCd -P r fussing the operation of the tool which has been de- 
ifelo °" WldCatter takCn fr ° m Raiffa < 10 >- 7,16 wildcatter must 

^s^ogcX^ TA^r which wU1 he,p determine the 

(2) whether or not to drill. 

He assumes the cost of drilling to be $70,000. He also assumes that one nf 
cond H lons !T iU r e ? i ?,. after dri " in 8- He wi " ^ve a d^hokf wWch lives Wm a 
$fo S ?„f I C °V d ? ing ' f, WCt i 10 ' 6 wiH » ve a return of |l20,000°fo?a Sof 
$50,000 and a soaking hole will produce $270,000 for a net of $200 000 Hi* h«t 
estimate of the probability for t£e three stated is 0.5, 0 3 and 0 rSpeS vely 

C °f of . a SeiSmic test is * 10 ' 000 and he allocates three possibilities for the 
0 ^^„H n n% S i rUCtUre V° P ? n ft ruct Hre or closed structure with probabi tie! o ? 0 41 
0.35 and 0.24 respectively. He estimates that finding an open structure indicating a 
return^ probabilLs of his^three driUmg 

nrnhoMv ' • • ° 048 - If tl »e seismic test shows an open structure his 
probabUities for a gam improve somewhat to 0.428, 0.342 and 0.288 A closed struc- 
ture substant.ally improves the probabilities to o!208, 0.375 and 6 416 
m cil *? a °I th, s project have been used in some of the previous displays FIG 
10 shows this data displayed on the tree. The top section is /or nose 2Sfc test A 
probability of one is assigned to the first brancf. of the second °ta|eTo indicate 

and n^ d r^° n - Th t flrSt three terminal benches are labeled with th^pSbabiUtiel 
and net returns when no seismic test is performed and a hole is drilled The next 
branch represents the situation where nothing is done "he second section Trenre 
sent* the condition where a seismic test is performed. The stige ttc ^ probabuft^ 
er£?„ft Ure T f 2 r ^ aforementioned structure possibilities 7nd lead * to thl 
iionm l b 'f f Che fu haVing P r <>babi hies conditioned by the type of strucfure The 
810,000 cost for the seismic test is reflected in the terminal values 

lfte decisions and the expected returns are represented bv the branches r>f 
stages one and three The broadened first stage branch (labeled ^49^ and the 

aZ£E? etur , n of *p' 4 ? 0 b y conducting a seismic test and then drilline if both 
T?u Et 1,1,8 the dri,lin S decision ca n be postponed unt after 

in fi^iTtL 8 °l P erf ° r,min g a sensitivity analysis on expected values are shown 

he has been loo conservative in his estimate of the probability of, obtaiSiS m« t 
a <est. If he increases his Estimate of this prob "biSfbC 

r» ,l e " ects ot changing the probabilities for a number of events The winter 
records the changes in probabilities, the corresponding branch numbers the new 
decision path and the new expectation for future reference nUmDerS ' the new 
; n th. ;l er * dec,si °" maker has determined his preference function as described 
^lSSi'ffla5sita^}? nter ^ repeat thc ' decision trec anal ^ s bS its 
SaSSKS Sve ii. ^T?s^h X o P wn1n d ^ ° f the ^ 

nrnfitc « A C t 1S1 °" Pa i h w bas u ed on r e xpected utility has not changed but the utility of 
profits as determined by the preference curve, decreases sufficiently with"ncreas- 
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ing profits as to make the project much less attractive. In addition, drilling is profit- 
able only if a seismic test is performed and a closed structure is obtained. 

As with the expected value analysis, the decision maker can select an auto- 
mated sensitivity analysis based on expected utility. He can also change any of the 
probabilities and repeat the preference analysis. When he repeats the preference 5 
analysis he can by-pass the curve assessment procedure and use the previously 
assessed curve. It will thus be seen that a tool has been developed which 
enables a decision maker to make decisions using decision tree analysis with selec- 
tion of alternates by the computer based on maximization of either expected value 
or expected utility. A graphic display provides him with patterns showing the inter- 10 
relationships of data and allows him to select alternate functions. He is also pro- 
vided with the necessary facilities to determine how closely he must estimate the 
probability of an event and what his decisions must be in order to achieve the 
expectation. 

15 . The decision maker is provided with sufficient flexibility in changing proba- 15 

bilities, values and his preference curve to give him control over the decision. He is 
provided with the framework which ties together these fundamental quantities, 
which in turn are tied closely to real world situations. The computer is sufficiently 
fast so that he can change one after another and observe the results nearly 

20 instantaneously and not lose his train of thought. 20 

The capability can be extended to situations involving more than two decisions 
by cascading. The output of one or more trees together with other data can be used 
as the terminal values for a second. Depending on the situation, the most serious 
limitations may come from the cascading of probabilities. If the decisions cover a 

25 period of years, the time value of money should be recognized. In many cases this 25 

can be done by adjusting the values when the trees are cascaded. 
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T , M1 . Bl ? ef Pescription of the Program Subroutines 

tollowing is a brief description of the program subroutines setting forth 
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their respective functions 
NAME CALLED BY FUNCTIONS 



MAIN 2 

ACTS 

ASPRF 

DTREE 



ICORR 
ICRVP 

INITB 
INITV 



INPUT 



ISTGB 



MENU 

PICRD 
PINVT 

PREFR 
PTREE 



MAIN 2 
MAIN 2 
MAIN 2 

MAIN 

INITV 
ICORR 

MAIN 
MAIN 



INITV 

ASPRF 

ICRVP 

INITB 
ICORR 



MAIN MAIN 2 



MAIN 
INITV 

ASPRF 

MAIN 2 

MAIN 2 



MAIN 
TREE 



MAIN LINE PROGRAM— retrieves from and stores 
on disk. Sets scales. Selection of "preference" 
"sensitivity", "fini", "store", "correct", "vary prob". 
Prints expectations. 

Broadens selected branches, displays and prints 
expectations. Prints numbers of selected branches. 

Assess and verifies DM's preference curve, has menu 
of "calculate" and "preference". 

Zeros expectations and decisions in arrays. Averages 
out and folds back from array "D" to "C", "B" and 
and ; 4 A" in column 3. In arrays "A" and "C", places 
maximum value for each node in olumn 4. Makes all 
utiles positive for preference analysis. 

Corrects probabilities and terminal values. 

Corrects terminal values and terminal 
probabilities, checks for sum of probabilities equal 
to one. n 

Input and correction for stage 2 probabilities. 

Obtains terminal values and terminal probabilities 
from DM and displays them on tree, provides skip 
node function and marker, checks node probability 
sum and provides for its correction, assigns act 
flags for stage 3. 

Asks DM for input values, checks for legal 
characters, compacts divides previous values by 
1 000 when M is used. 

Asks DM for stage 2 probabilities, 
Checks sum at a node, repeats for correction 
Corrects or varies stage 2 probabilities. Assigns and 
corrects event flags for stage 2, act flags for stage 1. 

Obtains input data from DM and provides correction 
facilities. Zeros arrays for new problem, displays 
first four branches of DT, displays scale change marker. 

Displays choices of: section to be magnified, 
"all sections", "stage 2", "store". 

Displays axes and labels for preference curve. 

Transforms expected utiles in column 4 of arrays "A" 
and "C" back into same dimensions as terminal values 
(act/event flag must be set for each branch). 

Transforms terminal values in array "D" into 
preference values. Shifts Pi's to make them all positive. 

Displays stages 2, 3, 4 of tree, (pruned or unpruned), 
terminal values or utiles, and terminal probabilities, 
spreads terminal values. 
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WHAT WE CLAIM IS:— 

1. A data processing system including a central processor, a graphic display 
unit, and programming means which cause the system to generate and display a 
decision tree, to assign probabilities and expected values to selected branches of 

5 the tree in response to input data, to modify the tree in response to operator selec- 

tion of branches therein, to calculate modified probabilities and expected values 
for selected branches of the modified tree, and to display the modified tree and 
modified probabilities and expected values on the display unit. 

2. A data processing system as claimed in claim 1 wherein the system is 
10 operable to determine highest expected value tree paths and to indicate such paths 

on the displayed tree diagrams. 

3. A data processing system as claimed in claim 1 or claim 2 wherein the 
system is operable to determine, from a set of branches extending from a node, 
that branch which is most sensitive to a change in the highest expected value tree 

15 path in response to a change in the probability assigned to the branch. 

4. A data processing system as claimed in claim 3, wherein the system is 
operable to calculate the magnitude of the change in probability assigned to each 
branch which becomes part of the highest expected value tree path, and to display 
an indication of said magnitude. 

20 5. A data processing system as claimed in any of the previous claims in 

which the system is operable to detect and display errors made in the assignment 
of said probabilities and values. 

6. A data processing system as claimed in claim 5 wherein the system is 
operable to determine whether or not the sum of the probabilities assigned to a set 

25 of branches extending from a node is unity. 

7. A data processing system as claimed in any of the previous claims, said 
system being operable to calculate and display preference curves of utiles plotted 
against values and to calculate the resulting expectations in utiles at selected nodes 
of the trees. 

30 8. A data processing system substantially as described herein with reference 

to Figure 21 when programmed as described herein with reference to Figures 8 
and 9 of the accompanying drawings, 

9. A method of programming a computer substantially as described herein 
with reference to Figures 8 to 20 of the accompanying drawings. 

A. G. F. HAWKINS, 
Chartered Patent Agent, 
Agent for the Applicants. 
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